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Amendments to the Claims : 

The following listing of claims will replace all prior versions, and listings, of claims in 
the application: 

1. (Currently Amended) A comput e r implement e d s y s t e m op e rativ e computer- 
readable medium encoded with instructions for causing a computer to recognize objects in 
content comprising: bv following the instructions to implement: 

a blackboard comprising 

a plurality of experts adapted to process data on a computer, and said 
data comprising at least one of original input data and/or data created by processing of any of 
said plurality of experts, and 

a controller operative to control said experts; 

a belief model, coupled to said controller, comprising a set of beliefs and 
probabilities associated with each belief of said set of beliefs, wherein said belief model 
comprises a set of rules deduced from a computer-implemented learning system, said learning 
system comprising truth data files for deducing said set of beliefs, said probabilities and 
shadow objects, a learning system controller and a statistics space controlled by said learning 
system controller, wherein said set of rules describes how different classes recognized by said 
learning system are related to each other spatially and physically; 

a belief network, coupled to said controller; and 

a relations subsystem, coupled to said controller. 

2. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein said experts comprise expert object recognizers comprising at least one of: 

region identification experts; 
color region experts; 
a corner recognizer; 
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a closed curve recognizer; 
a roof recognizer; 
a text recognizer; 
simulated experts; 
microphone recognizer; 
space suit recognizer; 
satellite recognizer; 

a geometric shape recognizer; a building recognizer; 

an egg recognizer; 

a dice recognizer; 

a person recognizer; 

a face recognizer; and/or 

a product recognizer. 

3. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein said data comprises at least one of: 

relations data; 

expert status data; 

image subsection data; and/or 

said belief model. 

4. (Currently Amended) The syst e m computer-readable medium according to 
claim 1 , wherein said controller is at least one of: 

operative to choose chosen experts from said plurality of experts which are to 

be executed; 

operative to schedule execution of said chosen experts; and/or 
operative to execute said chosen experts. 
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5. (Currently Amended) The syst e m computer-readable medium according to 
claim 1 , wherein said blackboard further comprises at least one of: 

storage for receiving an input image; and/or 

a reporter operative to output results of processing. 

6. (Canceled) 

7. (Currently Amended) The system computer-readable medium according to 
claim 1, wherein said belief model is operative to predict existence of a shadow object in an 
image even if there are no specific experts capable of recognizing said shadow object. 

8. (Currently Amended) The syst e m computer-readable medium according to 
claim 1 , wherein said belief network is operative to combine beliefs in output data output by 
said experts and probabilities drawn from said belief model into a single belief for a given 
object. 

9. (Currently Amended) The system computer-readable medium according to 
claim 1, wherein said relations subsystem is operative to determine how returned objects 
returned by said experts are related to each other. 

10. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein said relations subsystem is operative to determine spatial relations. 

1 1 . (Currently Amended) The syst e m computer-readable medium according to 
claim 10, wherein said spatial relations include types comprising at least one of: 

a north type, a south type, an east type, a west type, 

a contains type, 

a contained by type, and/or 

an adjacent to type. 

12. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein said relations subsystem is operative to determine temporal relations. 
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13. (Currently Amended) The syst e m computer-readable medium according to 
claim 12, wherein said temporal relations include types comprising at least one of: 

a before type, 

an after type, and/or 

an exists with type. 

14. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein the content comprises at least one of: 

video; 
an image; 

digitized content; and/or a frame. 
15-16. (Canceled) 

1 7. (Currently Amended) The sv s tom computer-readable medium according to 
claim 1, wherein said learning system is operative to assist in integrating a new expert, said 
new expert being adapted to create, encapsulate and compile said new expert; to add a stub 
function to said blackboard; if output of said new expert is new, to add the output to said 
belief model; and to add a blackboard rule to control when said new expert is to be executed. 

18. (Currently Amended) The syst e m computer-readable medium of claim 1, 
wherein said belief network is at least one of: 

a Bayesian Network; 

a mean probability; and/or 

a Dempster-Shafer Network. 

19. (Currently Amended) The syst e m computer-readable medium according to 
claim 1, wherein said belief model comprises: 

rules operative to be used to make a determination whether or not one of said 
experts should be executed by search of said belief model to determine whether an adaptable 

-5- 
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threshold of supporting evidence has been exceeded for an execution supportability rule that 
evaluates outputs of currently executing experts. 

20. (Currently Amended) The system computer-readable medium according to 
claim 1, wherein said belief model is operative to model expected object associations, to 
weigh relative object positions, and to tie a probability or belief value to those associations. 

2 1 . (Currently Amended) The system computer-readable medium according to 
claim 1 , wherein said belief network is operative to combine the belief model with hypotheses 
generated by said experts to form belief values for hypothesized objects. 

22. (Currently Amended) A computer implomonto d computer-readable medium 
encoded with instructions for causing a computer to implement a method of recognizing 
objects comprising: 

identifying classes of objects specified by a user using a plurality of 
cooperative object recognition experts; 

achieving higher accuracy from using in parallel said plurality of cooperative 
object recognition experts than is achievable using in serial said plurality of cooperative 
object recognition experts; 

supporting scaleability of performance including supporting multiple computer 

processors; 

developing a belief model by deducing a set of rules from a computer- 
implemented learning system, said learning system comprising truth data files for deducing 
beliefs, probabilities and shadow objects, a learning system controller and a statistics space 
controlled by said learning system controller, said set of rules describing how different classes 
recognized by said learning system are related to each other spatially and physically, the 
developing of said belief model including 

specifying specified associations among said objects, 

-6- 
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learning learned associations among said objects, 
representing said specified and learned associations, and 
forming a belief network 

wherein said belief network is at least one of a Bayesian Network and a 
Dempster Shafer Network; and 

deducing said shadow objects from said belief model. 
2 3 . (Currently Amended) A comput e r impl e m e nted computer-readable medium 
encoded with instructions for causing a computer to implement a method for adding a new 
expert to a blackboard comprising: 

creating an expert adapted for processing data on a computer; 

encapsulating said expert; 

compiling said expert; 

adding a stub function to a blackboard; 

determining if output of said expert is new and if new, then 

adding the outputs class to said blackboard, and 

updating a belief model by providing truth data file data to a computer- 
implemented learning system, said learning system comprising truth data files for deducing 
beliefs, probabilities and shadow objects, a learning system controller and a statistics space 
controlled by said learning system controller; 

creating a rule to control when said new expert is to be executed when 
supporting evidence is found to exceed an adaptable threshold; and 

deducing a set of rules from said learning system, said set of rules describing 
how different classes recognized by said learning system are related to each other spatially 
and physically. 



